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FOUNDATIONS FOR MATERIEL MANAGEMENT FUNCTIONAL MANPOWER STANDARD 



INTRODUCTION 



PURPOSE 

The purpose of this project is to assist the Air Force 
Logistics Coitimand (AFLC) in clarifying the functions, activities 
and indicators of effectiveness for the Directorates of Materiel 
Management (D/MMs) of the Air Logistics Centers (ALCs) . The 
results are intended to lay the groundwork for development of thi 
ability to identify, defend, and project manpower requirements 
for the Material Management Directorates. 



BACKGROUND 

At present the D/MMs do not have manpower standards. This 
makes it difficult to defend current manpower levels or to 
justify needed manpower increases. In the past manpower 
standards have been proposed or used for the D/MMs. These were 
met with resistance by various levels of D/MM management who 
believed the standards were inappropriate and did not accommodat 
the differences between the individual ALCs. D/MM management 
believed that, because of the different weapon systems being 
supported and the different missions assigned to each ALC, the 
role, structure and manpower requirements of each D/MM would be 
unique. There was also the belief that certain responsibilities 
of the D/MMs, such as technical and engineering support, did not 
fit the industrial engineering standards approaches. Since 
those responsibilities related to problem identification and 
solving, they were therefore "level of effort" rather than outpu 
oriented . 

This study uses the views of persons in and out of D/MM to 
develop and evaluate functional profiles of the D/MMs that might 
provide a basis for future manpower standards and includes three 
major elements: 

1) Systems analytic discussions of Materiel Management wit 
D/MM Division and Branch heads. 

2) Surveys of customers (LGs of the Major Commands) and 
users (other ALC Directorates and HQ-AFLC) regarding D/MM 
products, services and performance. 

3) Computer simulated evaluation of D/MM functional 
performance profiles by ALC, D/MM, and HQ executives. 

This report includes a section with description and results 
for each of the three major elements and a conclusion section. 
Supporting documents are included in the appendices. 
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SYSTEMS ANALYTIC DISCUSSIONS 



One of the aims of the study was to develop common 
understanding of D/MM functions, activities, priorities and 
options. A major mechanism for this was a series of discussions 
with groups of D/MM Division and Branch heads at the ALCs and at 
HQAFLC. The discussions were intended 1) to provide information 
to the researchers concerning the perceptions of D/MM personnel 
about their primary functions and priorities, 2) to investigate 
possible measures of effectiveness which might be appropriately 
used to evaluate D/MM performance, and 3) to develop common 
understanding among D/MM personnel of D/MM functions and 
priorities and to sensitize them to alternatives for greater 
effectiveness . 



PROCEDURE 

Visits were scheduled with each ALC and at HQAFLC through 
letters and informal contact. The visits were structured so that 
the researchers had opportunities to brief the Commander or 
Vice-Commander and the D/MM Director or Deputy. The briefs 
explained the nature of the research and requested cooperation 
in making personnel available for further discussions. These 
executives were also asked to discuss how they viewed the 
functions of their organization and how they believed its 
performance should be evaluated. 

Two-hour discussion periods were conducted with groups of 
Division and Branch heads and deputies. Two such discussion 
groups were held at each ALC and HQ. The groups were structured 
to provide a broad cross-section of the D/MM and did not normally 
contain both a manager and one of his or her direct subordinates. 
This structure was designed to encourage diversity of views and 
the free flow of discussion. Up to ten persons were involved in 
each discussion. The typical level of the participants was GM 
13-14 and military 05. The participants in the discussions were 
provided a short case study which included a set of questions 
around which the discussion would revolve. A copy of the case is 
provided in Appendix I. 

To initiate the discussion, participants were given a brief 
overview of the study and the contribution which they could make 
to it. They were then introduced to the structure of a systems 
analysis study. That structure was applied to their situation, 
stressing the need for a D/MM and how its activities were 
directed to meeting that need. The discussion then turned to the 
case study and asked the participants to explain to the 
researchers and to each other how D/MM could be viewed as a 
system and what its primary functions and supporting functions 
might be. The discussion moved to the other questions in the 
case as time permitted. 
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RESULTS 



All groups quickly agreed that the basic need D/MM sought t(,- 
address was the provision of logistics support to the operating ' 
forces, active and reserve, of the US and other nations. This 
was sometimes phrased as "Rubber on the ramp", "Sorties flown", 
or "Bombs on target". However, in attempting to more 
specifically define the role of D/MM in actual materiel support 
of operations, considerable disagreement emerged. 

The primary function of D/MM was often phrased as item 
management or system management. Vigorous disagreement occurred 
over which was the correct focus. The disagreement stems both 
from the individual's experience and current job and from the 
need for items and systems to compete for needed resources, both, 
personnel and money. We did not get the feeling that managers 
were trying to blow their own horns or build empires, but that 
they were strongly motivated to provide needed support to the 
operating forces. Through the discussions, considerable progress 
was made by the discussants in understanding the other point of 
view. The AFLC organization structure seems to contribute to thi 
problem, as there is no clear locus of system responsibility, nqi 
clear flow of authority over system requirements. 

The nature of D/MM's role in the logistics process makes it 
difficult, if not impossible, to discuss its function without 
also including the functions of other directorates or 
organizations. The discussants could easily point to the 
outcomes of the overall process, e.g., fully mission-capable 
aircraft, equipment which was not operational, sortie capability 
of squadrons, wartime readiness, etc. None of these, however, is 
solely attributable to the efforts of D/MM. Changes in the 
outcomes may be due to policy changes, political pressures, 
failure of a contractor to deliver the proper item at the right 
time, or unscheduled changes in the operating tempo of the 
forces, as well as performance difficulties in other 
directorates . 

Some of the groups tried to move the effectiveness measure 
from readiness to something closer to their efforts and suggested 
that their function was to procure, store, and deliver items. 
Again the involvement of other organizations creates problems in 
definition and measurement since D/MM does none of these 
activities, but is involved in the direction, control, and 
planning of all of them. The next step in the chain of 
activities leads to an impossibly long list of all the individual 
activities that D/MM engages in. A list of individual activities 
does not help D/MM to focus on what it does since the individual 
acts are minute and are interwoven with each other to form the 
fabric of logistics. As in a fabric, the threads are in the 
pattern but are not the pattern. What is true of a fabric is 
also true of a system, the outcome is determined by the j 

relationships as well as the elements. D/MM is the overseer and 
architect of many elements of the logistics system, but is not. 
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in and of itself, a logistics system. 

In some of the discussions we introduced the recently 
promulgated Combat Support Doctrine as a means of guiding the 
discussants in focusing on the role of D/MM. They found it not 
to be a useful way of dealing with D/MM functions because the 
functions change, depending on the particular piece of equipment 
or system and particular point in its life cycle. 

We also used a view of an organization as a system which 
takes a set of inputs, puts them through a transformation 
process, and produces outputs. The outputs then interact with 
the environment to produce outcomes. Although D/MM may view 
itself as the transformation process that produces output, other 
organizations are also a part of that transformation process. 

Discussants tended to fall back on analogy to describe the 
function of D/MM. A favorite analogy is that of the quarterback 
on a football team. The quarterback calls the signals that tell 
other team members how to perform their duties for a particular 
play. Without the coordinating function of the quarterback, 
there would be no team directed toward a common goal, but a set 
of individuals doing what seemed best at the moment. Another 
favorite analogy is the hub of a wheel. The hub acts to hold the 
wheel together and to control the spokes and rim in the 
performance of their duties. Both analogies break down when 
pursued very far. 

Although they clearly knew what they did and why, the 
discussants were not able to articulate this knowledge in a way 
which obtained full agreement of the other members of the group. 
However, the group members were in a better position at the end 
of the sessions to understand the broad picture of their own and 
others' work in the D/MM. The discussions also provided 
extensive lists of activities and other information used in 
formulating the list of functions utilized in later parts of the 
study. The list of functions is provided as Figure 1. 

When asked to spell out the priorities of the functions or 
activities of their organization, discussants encountered 
considerable difficulty. Responses to questions of what they do 
when resources are too scarce generally fell into three 
categories: 

1) Cut all the activities by the same amount, or continue 
to do everything but with less precision or depth, 

2) Delay or not perform things like file maintenance, and 

3) Cut or omit some of the things with no immediate 
consequence such as long term product improvement, reverse 
engineering, re-analysis of failure data or ILS planning. This 
lack of agreement on the priorities means that managers have 
little common guidance when faced with the decision to allocate 
scarce resources in their organization. It also increases the 
likelihood of conflict, since managers lack a set of mutual 
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FIGURE 1 



MATERIEL MANAGEMENT FUNCTIONS 



A. Data Collection Analysis and Reporting 



A1 . Item/Equipment/Tech Data Specification 

A2 . Operational/Failure Data/Requirements 

A3. System/Conf iguration Support and Records 

A4 . Logistics Resource Plans/POM/Budget Data 

A5 . Inventory/Status Management 

A6 . Inspection/Readiness/Status Reporting 

A7 . System/Maintenance/Equipment Conferences/Surveys 



B. Requirements Determination and Programming 

Bl. Systems/ILS/PMRT Planning and Review 

B2 . Parts/Items/Supplies Planning and Allocation 

B3 . Test/Support Equipment Planning and Allocation 

B4 . Budget/Resource Planning and Allocation 

B5. WRSK/Mobilization Planning and Review 

B6 . Disposal/Disposition 



C. Technical and Engineering Support 

Cl. Technical Orders/Manuals/Procedures 

C2 . Modifications/Improvements/Problem Solutions 

C3 . Software Design/Development 

C4 . Safety/Mishap/Defect Investigation 

C5 . Configuration/Integration Management 

C6. Hardware/Equipment Design and Management 



D. Acquisition and Distribution 

Dl. Production Planning and Support 

D2 . Purchase Initiation and Management 

D3 . Distribution Planning and Direction 

D4 . Contractor Qualification/Evaluation/Interface 

D5 . Maintenance/Repair/Modification Management 
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expectations of the availability of support from others in terms 
of resources, information, technical data or plans. 

Lack of agreed-upon priorities forces managers into a 
reactive mode. If it is true, as one group maintained, that 50% 
of their work is in reaction to a current crisis, change in 
policy, or change in plans, the manager will focus on the short 
term problems at the expense of the other 50%. The long run 
health of the logistics system will deteriorate as managers run 
short of resources and lessen the pro-active role of dealing with 
the underlying causes of the problems. The result of this 
neglect may appear two to six years in the future. 

In most of the discussion groups, time did not permit 
exploring the participants ' suggestions of improvement 
alternatives in D/MM. When these were discussed, many of the 
alternatives mentioned were the same as those covered by the 
survey responses (see Appendix V) . Coming from D/MM rather than 
customer or user viewpoints, they had some views not duplicated 
in the surveys. 

The most important of these seems to be to request 
Congress, DoD, and USAF to eliminate some of the resource 
fences, regulations, policies and over-management that 
prevent D/MM from effectively managing the available 
resources. The need for managerial flexibility is 
paramount. Clarification of authority and responsibility is 
also vital. The LOC and AFALC were most often cited as 
sources of disruption due to unclear authority and 
responsibility. 

Managers pointed to the need for effective employee 
development programs. Although they cannot do this 
themselves, they realize there are many long-term problems 
such programs could help avoid. The need for accurate 
current data is felt throughout D/MM, but the new ADP 
systems will intensify the need for employee development. 

D/MM managers are subject to more than 185 management 
indicators. These are not systematized so as to provide 
guidance. The managers need measures of merit that connect 
job plans, etc, to higher level measures. Each new 
management fad or policy perturbation creates new reporting 
and audit requirements without adding to the reality of 
efficiency or effectiveness. 
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SURVEYS 



The research plan called for a survey of D/MM customers 
concerning the support needed or received from D/MM. The term 
"customer" included the other directorates within the ALCs and 
the LGs at the major commands. The D/MMs felt it would be more 
appropriate to refer to the other ALC directorates as "users", 
since to the D/MMs a customer can only be one of the other major 
commands such as TAG or SAC. Accordingly, the research was then 
divided into two parts to include surveys of customers and users 
i.e. ALC directorates that use or receive D/MM output. 



PROCEDURE 

In order to develop the survey, we prepared a preliminary 
open-ended survey that we took to the first three sets of system 
analytic discussions. We asked the directors or deputy director; 
of each D/MM to review it and make comments. We also sent it to 
a small sample of the survey population. The final survey 
(Appendix II) was developed using the input from this preliminar 
survey and incorporates many of the ideas put forth in the 
systems analytic discussions. 

The survey provided a list of four major functions divided 
into 24 subfunctions of the D/MMs. For each subfunction, 
respondents were asked to evaluate the performance of D/MM, 
assess its importance to the respondent's organization and 
describe the role currently being performed by D/MM. There were 
six role definitions; tasking, policy, coordination, advice and 
information, service, and control, plus an option of no role. 
Respondents were then asked to go through the functions again butj 
this time indicating the roles that D/MM should be performing. , 
These responses might or might not agree with their initial 
responses. They were also asked to assess the importance of 
these "should" subfunctions/roles to their organization. 

The intent of the survey was to identify customer and user ) 
perceptions of the subfunctions and roles being performed by the j 
D/MMs. It was also intended to provide feedback to D/MM 
regarding customer and user perception of D/MM performance as | 
well as assessment of subfunction importance. We also hoped to 
identify areas where customers and users believe that D/MM is 
performing unnecessary or incorrect roles or is not performing 
necessary roles. This does not imply that D/MM is in error in 
such instances but it does point out areas where further 
investigation is indicated. 

Copies of the survey were sent to the major directorates at 
each of the five ALCs and to the LGs at the major commands. 
Copies were also sent to HQAFLC-MM at their request. Responses 
were entered into a database -DBASE III- so that sorting and 
comparisons could be performed. Using the database we were able 
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to aggregate the data and perform statistical analysis using 
statistical software packages -STATGRAPHICS and LOTUS 123. 



RESULTS 

We received 135 responses to the survey, of which 122 were 
complete and usable. The characteristics of the sample indicates 
that it is broadly representative of D/MM customers and users. 

The experience, tenure and knowledge of the respondents, as 
shown below, makes their views highly credible and worthy of 
serious consideration. 

60% of the respondents have worked in a Directorate of 
Materiel Management. The median personal frequency of contact 
with a D/MM is once a week or more often. The support received 
from D/MM is rated satisfactory by at least 50% of the sample. 
Concerning their knowledge of Materiel Management, on a scale of 
1 (very little knowledge) to 6 (highly knowledgeable) , the median 
response was 4; the interquartile range (middle 50%) rated 
themselves as either 4 or 5. The median time in current position 
was 27 months, with the middle 50% having 13 to 48 months. Half 
of the respondents said their organization's mission performance 
was greatly or very greatly dependent on D/MM. Half also said 
that D/MM's performance was greatly dependent on their 
organization. 

Appendix III summarizes, by organization code, the number of 
respondents who indicated for each subfunction a specific role 
that they believe D/MM is actually performing versus the roles 
they would prefer D/MM to perform with respect to their 
organization. This data may assist D/MM in examining the 
appropriateness of the roles for each subfunction. 

Appendix IV provides the average performance ratings, on a 
scale of 1 to 5, given in response to the question " To what 
extent does D/MM maintain an adequate level of performance for 
this function?" This information is provided for D/MM review and 
use. 



The survey gave respondents opportunities to make open-end 
comments. These are listed in Appendix V, organized by position 
or organization code. The following is a synopsis of those 
comments : 

Survey Part IV -Evaluation- "On what basis do you think the 
ALC Directorate of Materiel Management should be evaluated? List 
as many criteria as you believe appropriate." 

Respondents in all categories mentioned customer support and 
MICAP rates as bases for evaluation. Most of the other comments 
fell into the categories of quality, timeliness, efficiency and 
accuracy. By organization code, the number of such comments are 
shown in Table 1. 
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Table 1 





FREQUENCY 


OF EVALUATION 


CRITERIA CITATIONS 






Oualitv 


Timeliness 


Ef f iciencv 


Accuracv 


Otheij 


CR 










1 


PS 


4 


9 


8 


4 


6 t 


MA 


12 


9 


5 


20 


5 1 
^ 1 


PM 


11 


14 


18 


6 


7 i 


QA 


3 


3 




1 




SI 




2 


3 


2 


2 

1 


SW/SF 






2 




i 

S 

( 


2^ 


2 




3 


1 


• 1 

1 


LG 


5 


22 


1 


10 


11 


HO/MM 


7 


5 


8 


2 


1 ^ 


Total 


44 


44 


48 


46 


33 : 



Survey Part V -Improvements - "Please list specific things 
that could be done to improve the efficiency or effectiveness of 
ALC D/MM." 



Seventy nine of the 122 respondents provided one or 
more comments in this part of the survey. While a few could 
be characterized as gripes, the preponderance of the 
comments dealt with problems or areas of importance to the 
respondents . 

Twenty seven of the comments can be classified as 
dealing with organization and management of D/MM. These 
include topics within D/MM, between D/MM and other 
directorates, and across the ALC. Included are such topics 
as suggested changes in authority and responsibility, 
reduction of meetings, reassignment of reporting 
responsibility, job rotation policies, and streamlining of 
decision-making processes. 

Twenty of the comments were about the training and 
knowledge of personnel within the D/MM. Lack of familiarity 
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with field and other directorate operations were noted as 
well as the need for both in-depth and cross training for 
all D/MM personnel, especially IMs and SMs. 

Sixteen comments were made about specific operating 
procedures that might improve productivity. 

There were also sixteen references to inadequacies, 
improper usage, or suggested improvements in data and 
information systems. 

Two-way communications were the focus of fifteen 
comments. The principal concern was the need for greater 
communications, coordination, and understanding among those 
concerned with logistics services to the operating forces. 

Nine comments addressed a perception that some D/MM 
personnel appear to have uncaring and unhelpful attitudes 
toward their jobs and the needs of others. 

Seven commented on the need to improve the results of 
planning, estimating, forecasting and requirements 
computation procedures. 

Seven also commented on the need to reduce procurement 
lead times and improve response time for inquiries and TO 
changes . 

A wide variety of other suggestions were made in these 
comments. It should be noted that only three mentioned 
staffing levels and only five seen to be directed toward 
inventory levels and availability of parts. 



Survey Part VI -Comments- "Please use this space for 
comments you wish to make or to address other questions you 
believe should have been included in the survey." 

Thirty two of the 122 survey respondents made comments 
in this section. Considering the time required to complete 
the previous sections, this indicates a deep concern about 
D/MM on the part of the respondents. 

Fifteen comments referred to the survey itself. These 
included those who felt the survey did not allow them to 
correctly describe their relationship with D/MM and those 
who sought to amplify or clarify their responses to previous 
sections . 

Ten comments were critical of current D/MM actions and 
attitudes or suggested ways D/MM could change its actions 
internally or with other organizations. 
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Five comments concerned problems or recommendations 
related to current organization structure. 

Additional comments dealt with the need for parts, the 
role of reserve components, shortcomings in D/MM knowledge 
of the operating forces and difficulties with existing 
information systems and their uses. 
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PROFILE MODELS 



The research plan called for the utilization of the 
information from the systems analysis discussions and the surveys 
to develop a list of ALC-D/MM functions that would form the basis 
of profiles of various aspects of D/MM performance. Attaching 
weights to the functions and sub-functions would enable us to 
examine the extent of agreement among executives and establish 
common ground for use in application of manpower standards. 

The functions list (see Figure 1) includes four major D/MM 
functions : 

A) Data Collection, Analysis, and Reporting (seven sub- 
functions) , 

B) Requirements Determination and Programming (six sub- 
functions) , 

C) Technical and Engineering Support (six sub-functions) , 

D) Acquisition and Distribution (five sub-functions) . 

This set of functions can be viewed as a hierarchy that, taken as 
a whole, represents the basis upon which overall D/MM performance 
can be judged. 



PROCEDURE 

Putting the functions into a computer program, EXPERT87, 
provided a means to simulate the judgment tasks that would be 
involved in evaluating D/MM performance using this structure. 
EXPERTS? is called a quasi-artificial intelligence approach to 
decision support. It is designed to: 1) capture a decision- 
maker's intuitive judgments of the relative importance of a 
hierarchy of decision criteria, 2) develop a set of mathematical 
weights, and 3) to use the captured judgments to evaluate 
alternatives in which the decision maker is interested. The 
judgment capture and weight development features are used in this 
study. Use of the alternative evaluation features would require 
performance data from the various D/MMs in terms of the list of 
functions. Such data is not available at this time. 

Two hour time blocks were requested of the Commander or Vice- 
Commander of each ALC, the Director and Deputy Director of the 
D/MMs, DCS-MM and his staff, and other individuals knowledgeable 
about overall D/MM operations. Because of the length of time 
required, vacations, TDY, and other factors, not all of the 
requested appointments could be established, substitution occurred 
of an acting manager for the regular manager, and some individuals 
were unable to complete the evaluation of the entire hierarchy of 
D/MM functions. 

The EXPERTS? program and the D/MM hierarchy of functions were 
installed on a GRID brief-case portable computer. This enabled 
the executives to perform the evaluations in their own offices 
where they could most easily put themselves in the mode of 
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examining and evaluating D/MM performance. 

The list of functions was shown to the executive and its 
development process was explained. Opportunity was given for th . 
executive to add or delete functions if they chose to do so. No j 
additional functions were proposed and none were deleted by the ' 
executives. The purpose of the research was also explained and 
the projected reporting of the results. Following a brief 
introduction to the simulation process, each executive then 
evaluated the relative importance of the four major functions an( 
each set of sub-functions. After the completion of each set of 
functions the executive was shown the weights which the computer 
program had calculated for that set and asked whether he or she 
agreed that the weights represented their judgments of the 
relative importance of the various functions or sub-functions. 
When the weights were felt to diverge from what they intended, 
that set of functions was redone. 

The simulation used to develop the weights operates by 
providing a set of statistically derived profiles of the 
functions. The executive is asked to assume that a given profile 
represents the actual measures of performance of a D/MM for a 
particular week and judge the overall or summary performance leve 
value that he or she would assign that particular profile of 
performance. After receiving their judgments about a series of 
these profiles, the program then develops the set of mathematical 
weights that are implied in the executive's judgments. 



RESULTS 

Usable results were obtained from twenty three executives whc 
completed all or most of the five sets of profiles. These 
included eleven officers (2 Major Generals, 4 Brigadier Generals, 
and 5 Colonels) and twelve civilians (4 Executive Service and 8 Gl' 
grades) . They were from all ALCs and HQ (5 HQ-AFLC, 3 OC-ALC, 4 
00-ALC, 4 SA-ALC, 4 SM-ALC, and 3 WR-ALC) . Thus the sample, while 
not perfectly balanced, is broadly representative of Materiel 
Management executives across the various locations and includes 
both military and civilian perspectives. 

Results of the profiles were compared to determine areas of 
agreement and disagreement in terms of the relative weight or 
importance attached to each function and sub-function. Bar graphs 
of the weights are presented in Appendix VI. Two bar graphs of 
the four major functions are shown in Figures 2 and 3 representing 
the average and individual weights of the four primary functions. 
Even though the averages in Figure 2 obscure some of the variatior 
in the results, the graphs show clearly the wide diversity among 
the executives regarding the importance of the primary functions. 

The average weights given by these executives as the relative 
contribution of the primary functions to overall D/MM performance 
were : 
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Figure 2 

PRIMARY MM FUNCTIONS 
% BY LOCATION 



LEGEND 




OO OC HQ SA SM WR 

LOCATION 



Figure 3 

PRIMARY MM FUNCTIONS 
INDIVIDUAL VALUES 
BY LOCATION 



100 - 



go- 



80- 



cn 



70' 



I 1 

Z 60- 
LiJ 
O 

g 

o 



30- 



20 — 



10 - 



/ 

/ 

/ 

/ 

I 

I 

I 

k 






/ 









/ 






S: 



I 






/ 

/ 

/ 

I 






LEGEND 



OO OO WR WR 
OO OO WR SA 



SA SA HQ HQ SM SM OC OC 




SA HQ HQ 
LOCATION 



HQ SM SM OC 



15 












Data Collection Analysis and Reporting 
Requirements Determination and Programming 
Technical and Engineering Support 
Acquisition and Distribution 



weight = . 15 
weight = .33 
weight = .24 
weight = .29 



In Figure 2 the primary function weights show the 
considerable diversity of the D/MM locations from each other as 
well as from the overall averages, shown above. Does this 
diversity indicate basic differences in mission and 
responsibilities among the various ALCs? In discussions with D/M| 
people across the ALCs, they commonly cited differences in missio 
and assigned support programs as reasons why the D/MMs at the 
several ALCs could not be measured by common yardsticks nor be 
expected to conform to common manpower standards. The answer to 
the diversity question, then, is important to the idea that there 
may be a common framework for discussing or measuring the D/MMs. 

In order to examine this question an analysis of variance 
(ANOVA) was conducted for the set of four primary functions and 
for each set of sub-functions. The analysis of variance 
consistently showed the F-ratio (the statistical sampling 
distribution used to test the ratio of the variances) for the 
between group variance to be too small relative to the total 
variance to be considered significant. This means that although 
the averages from each location differ from each other, the 
difference is not attributable to location but is simply due to 
random variation in the responses. Put another way, this says 
that the differences in the views within each location are so 
large that one cannot attribute any difference in the weights to 
the assigned responsibilities of the D/MMs. This is illustrated 
in the bar graphs in Figure 3 . 



Further illustration is provided by the box and whisker plot 
in Figure 4 . The box for each location represents the inter- 
quartile range or the middle 50% of the responses, 25% 
above and 25% below the median response. Whiskers or lines extend 
up and down from the box to indicate the range of the responses. 
The wide variation of the responses within each location is easily 
seen and clearly overshadows any differences between the median 
values of the location groups. Requirements Determination, 4b, 
has the highest F-ratio of the four primary functions, resulting 
from the greater difference between locations and lesser variation 
within most locations. 



Are there significant differences between locations for the 
sets of sub-functions, as Figure 5 seems to show? ANOVA was again 
used, with the value being computed for each of the twenty four 
sub-functions. The F-ratio for the amount of the total variance 
that could be attributed to the groups reached significance level 
of .05 only once out of twenty four times, which is what would be 
expected by chance alone. There do not appear to be any important 
differences in the weights that can be attributed to the location 
of the respondent. 
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similar tests were applied to the function weights after 
grouping them by rank or grade level of the executive. These 
tests also failed to show significant differences. It is clear 
that the executives differ in the relative weights given to the 
various functions, but these appear to be individual differences 
and preferences and not attributable to the job nor to differences 
in the assigned missions of the ALCs. 



COMPARISON WITH SURVEY RESULTS 

How does the relative importance of the sub functions derived 
from the profiles compare with those from the surveys? 

The two sets of information are not directly comparable due 
to scale differences. We converted the profile percentages to 
rank order for the D/MM executives' weightings. We also computed 
the average importance from the preferred D/MM roles section of 
the survey and converted these to rank orders. 

Figure 6 shows the ranks from the executives for the four 
major functions and for each set of sub-functions. It also shows 
the ranks for each set of sub-functions as rated by the LGs, HQMM, 
and the other ALC directorates as a group. The survey did not 
evaluate the major functions, only the sets of sub-functions. 

Although the rankings look similar in some respects, a 
statistical test is required to evaluate whether these are simply 
chance variations. The Spearman Rank Correlation is designed for 
such a test. Basically, it compares the consistency of the rank 
values with the consistency which would occur due to chance. We 
used the .05 level of significance (1 chance in 20 of accepting a 
chance variation as real) and compared the ranks from the 
executives and three groups of survey respondents for each of the 
four sets of sub-functions. 

For set A (Data Collection/Analysis/Reporting) the ranks are 
statistically significantly correlated at the .05 level between 
ALC (user directorates) , Executives, and HQMM. 

For set B (Requirements Determination and Programing) the 
correlation of the ranks is significant at the .05 level for HQMM 
and ALC user directorates. 

For set C (Technical/Engineering Support) and set D 
(Acquisition & Distribution) no correlation reached the .05 level. 

The fact that none of the 24 comparisons reached the .05 
level of significance for the LGs is worth noting, for it raises 
the question of how well the customers are being served by the 
D/MMs. In general there is only minor commonality among the four 
sets of ranks. Again the problem of lack of common agreement 
regarding D/MM functions is highlighted. 
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Figure 6 
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CONCLUSION 



We were frequently told that common manpower standards for 
the D/MMs are unworkable due to the greatly differing missions to 
be performed at the different ALCs. Comparisons based on the list 
of functions developed in this study do not support that 
statement. There were large differences in perception regarding 
the functions and roles of the D/MM, but no statistically 
significant correlation between these differences and the ALC to 
which the respondents were assigned. The data indicate that 
within each ALC, and within the D/MM of each ALC, there is little 
agreement as to what the functions and particularly the roles of 
D/MM are. The general resistance to manpower standards within the 
D/MMs is therefore more easily explained by this lack of consensus 
within the D/MM community on the importance and roles of the 
functions than by the different tasks assigned to the ALCs. 
Although the work assigned to each ALC does vary, the differences 
among the D/MMs appear to be of degree rather than of basic 
functions. One D/MM may perform more engineering services than 
another and may do more item management than weapon systems 
management. The critical point however, is that they all perform 
engineering services, and item and weapon systems management; it 
is the mix rather than the components -with limited exceptions- 
which vary. 

Because the Systems Analytic Discussions, Profiles and, to a 
limited extent, the Surveys indicated that functions and roles of 
D/MM are not clear, it would seem unlikely that normal industrial 
engineering studies would be successful. It was clear in our 
discussions that the different management levels within D/MM 
seldom discuss the goals and management philosophies of their 
organization as a group. It was also clear however, that the 
managers are very dedicated and want the D/MM to successfully 
serve its customers. 

It would appear beneficial for the management cadre of the 
D/MMs to occasionally meet as a group and discuss the functions, 
roles and measures of effectiveness of the organization. In an 
organization such as D/MM, these tend to change or get out of 
focus with time, with new responsibilities and new directors. 

Once the management of D/MM agrees on these items, then the 
possibility of developing meaningful standards becomes more 
realistic. 

As a beginning we would recommend that D/MM use the list of 
primary functions and subfunctions developed in the project as a 
comprehensive list of the range of functions performed by D/MM. 
This list was developed from the discussions at all the ALCs and 
from comments received in the preliminary surveys. Additionally, 
no one recommended additions or deletions to it even though the 
surveys and discussions provided frequent opportunity to do so. 

We recommend the use of this functions hierarchy and EXPERTS? in a 
re-study of the development of appropriate functional weights. 
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making certain that ample time is given to avoid the individual 
substitutions and incompletions which occurred in this study. 

The roles that customers and users prefer D/MM to perform fo; 
each function are very different from D/MM's view as the 
"quarterback". Considerable effort and study needs to be given tt 
clarifying D/MM's image as a facilitating and service organizatioi 
rather than as a "quarterback". 

Emphasis should be placed on ensuring that the D/MM is 
performing the appropriate roles with respect to each function. 

The customers and users indicated many instances where D/MM is 
performing a directive type role when they believe it should be 
more of a supportive role. This causes a duplication of effort 
and personnel. If D/MM is correct then the other directorates 
should adjust, if the other directorates are correct then D/MM 
should adjust. 

Once the functions and roles have been agreed to, then 
attention should be directed toward finding appropriate measures 
of effectiveness for each function. This frequently requires 
using a proxy for the true measure. When these have been 
established there will be a basis to begin the development of 
manpower standards that are output- and outcome-related. This 
will also provide the basis for building a set of measures of 
merit connected through the functions to overall effectiveness. 
These would replace the reliance on the current proliferation of 
unconnected management indicators. A more comprehensive systems 
analysis is needed to lay the groundwork for this effort. 

We wish to comment here that clarification must be made 
regarding the role of D/MM Weapon Systems Managers (PMs or SPMs) . 
Their relationship to the LOG, AFALC and Item Managers should be 
clearly specified. If it is not, there will always be problems 
with measures of effectiveness and subsequently in the acceptance 
of manpower standards. 

Agreement on functions and roles and clarifying of 
responsibility for aircraft and weapon systems, particularly after 
PMRT, will provide D/MM managers with better understanding and 
guidance on their roles. Additionally they need to be given the 
authority to manage the allocation and use of their resources 
without second guessing by HQ, LOG, AFALG or other organizations. 
D/MM and the ALG have excellent managers who need and want the 
opportunity to manage with a clear expectation of the support they 
will receive from inside and outside their organization. They 
hold strong opinions and are forceful in presenting their ideas 
about what ought to be done and about what it is that keeps them 
from doing the best job possible. They were nearly unanimous in 
their opinion that Headquarters gets too involved and sends out 
too many burdensome directives and requests for information that 
is already available. 

W. Edwards Deming has estimated that "15-40% of the cost of 
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almost any American product you buy today is for waste embedded in 
it." We do not have an estimate of the waste in D/MM, but it 
seems clear that the functions are so fractionated and unfocused 
that waste is bound to occur and the emphasis on quality is being 
lost. The need is to focus on high quality work in a few key 
areas and not try to do everything. Examples abound in the survey 
comments, to illustrate only one - 

D/MM could let D/MA plan for needed parts and 

schedule for a modification kit. Since D/MA will 

have to plan and schedule anyway, considerable 

time, effort, and acrimony will be saved by effective 

delegation and decentralization thus avoiding doing the job 

twice. 

Even small reductions in the number of transactions by D/MM will 
yield large resource savings due to the large number of times each 
of the transactions occurs. 

Utilization of the study's list of D/MM functions in a pilot 
study would be useful to estimate the feasibility of this 
functional approach to developing standards, to evaluate D/MM 
internal overhead functions, and to provide a rough cut at 
manpower requirements numbers. A pilot study would examine the 
amount of time spent in each function by a sample of D/MM 
personnel. The basic steps would be: 

1) Construct a set of internal support functions. 

2) Construct a matrix of time spent in each function for a sample 
of D/MM personnel. This includes estimating the task complexity 
and stability for the functions. 

3) Measure results, direct and indirect, of each position. 

4) Relate functional activities to outcomes, to provide the 
beginning of a manpower data base system. 

Given the current state of agreement on D/MM functions and 
their relative importance, it does not seem likely that the 
present approaches to manpower requirements will be effective. It 
is possible to derive relations between specific activities and 
time requirements, as the Management Engineering Teams have shown. 
The difficulty is that the individual position requirements will 
not sum to produce overall requirements. The failure to sum stems 
partially from the fact that positions have different content and 
responsibility and are only partially transparent with regard to 
organization. A more important reason is the lack of agreement on 
the priority of functions, which implies that differing amounts of 
manpower resources will be applied in each ALC. 

It seems to us that a different approach might be tried in 
justifying manpower requirements. Attack the problem at the level 
of the proposed functions. Estimate the time required for these 
functions to provide the desired level of service and response 
time for each major weapon system or other aggregate. Then 
compute overall requirements. This could also provide visibility 
to the real cost of retaining obsolete weapon systems and 
equipment. This approach might also provide the manpower 
equivalent of a statistical cost-estimating relationship for 
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estimating the logistics manpower requirements of proposed new 
weapon systems. 

i 

HQAFLC should eliminate as many restrictions as possible oi 
D/MM and ALC managerial flexibility in resource use. It should 
also work to reduce resource fences, regulations, policies, and 
micro-management by other Air Force units, DoD, and the Congress 
Proliferation of such limitations severely restricts the ability 
of D/MM and ALC managers to efficiently and effectively use thei 
resources. 

Eliminate or de-emphasize the existing management indicator 
and develop measures of merit that connect job plans and functic 
to higher level measures of effectiveness. 

D/MMs should be encouraged to establish their own internal 
teams to make recommendations concerning use of the data and 
comments provided in the appendices, as that analysis is beyond ’ 
the scope of this report. 

Based on the comments of James Wade and Richard Biedenbende 
in the recent Defense Management Journal, it appears the time is 
right to make some bold moves to correct some of the present 1 
approaches and take a major step forward in the future provision] 
of logistic support. We hope that this report is a clear step i:] 
that direction. ( 
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APPENDIX r 



CASE DISCUSSION 
MATERIEL MANAGEMENT 



(The following material is presented for discussion 
is not to be construed as an official statement of 
responsibilities, or activities of materiel 
organizations. ) 



purposes ar 
the duties 
managemer 



The Directorates of Materiel Management are responsible fc 
the worldwide logistics support management of weapon systems 
programs, items, and other materiel for the Air Force. They als 
manage certain materiel items for the joint services and for th 
federal supply system. 

1 

The Deputy Chief of Staff for Materiel Management haj 
directed that manpower standards be developed for materie ' 
management functions. Such standards are necessary for effectiv 
management and for projecting and defending manpowe.!; 

requirements. Past efforts to develop and apply manpowe.'i 
standards to the materiel management functions have been onl;; 
partially successful. This has been due to the complexity of thi! 
functions, their intrinsic overhead nature and the majoji 
differences in the assigned responsibilities of the individua.j 
ALCs. Taking these factors into consideration, HQ/AFLC ij. 
employing significant resources to establish manpower standards', 
which may be applied to all the materiel management 

organizations . 

In parallel with the development of those standards, HQ/AFLC 
wants to develop a common understanding at the ALCs of the 
nature, goals, functions, and measures of effectiveness of 
materiel management organizations. Doing this requires taking a' 
few steps away from the immediate problems to gain a better' 
perspective of what MM is doing. In this case study, we ask you 
to take those few steps and exercise a different perspective. 

* * * * 

Miller and Vollman, in a recent Harvard Business Review 
article, "The Hidden Factory", point out that "overhead costs as 
a percentage of value added in American industry and as a 
percentage of manufacturing costs have risen steadily for more 
than 100 years...", rising from about 52% in 1875 to 75% in 1975. 
This reflects the increasing number and complexity of the 
transactions or exchanges of material and/or information 

necessary to modern organizations. In the Air Force this 

increase in transactions is further pushed by the proliferation 
and increasing complexity of weapon systems, as well as by the 
pressures resulting from being the sole buyer in a non- 

competitive market. 
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according to 



These exchanges of material and information, 

Miller and Vollman, include: 

Logistical transactions - which order, execute, and confirm 
movements of materials from one location to another. 
Balancing transactions - which ensure that supplies of 
materials, labor and capacity are equal to demand. 
Quality transactions - which include engineering, specifica- 
tions, procurement, certification, quality control and 
developing and recording relevant data. 

Change transactions - which update information systems to 
accomodate changes in design, schedules, standards, and 
specifications . 

Although MM does not perform them all, the above activities 
indicate the magnitude of the task MM faces and helps give some 
perspective on the difficulties involved in establishing manpower 
standards when these transactions are in constant flux. 

As a means of gaining greater common understanding of the 
roles and activities of Materiel Management, we ask you to be 
prepared to discuss in some detail your views with regard to the 
following questions: 

1. What are the primary and supporting sub-systems which compose 
the overall system that is called Materiel Management? 

(Focus on the functional sub-systems or programs.) 

2. What special features distinguish this overall system and its 
component sub-systems from the other programs or systems 
related to them? 

3. What is the objective of the overall system? 

4. What are the objectives of each of the sub-systems identified 
in your answer to question 1? 

5. With respect to the overall system: 



a. 


What could 
system? 


be 


some measures 


of 


effectiveness of 


the 


b. 


How could 
collected? 


the 


actual data 


for these measures 


be 


c . 


If actual 
comparisons 


data on effectiveness 
might be made? 


were collected. 


what 



6. Temporarily disregarding cost and feasibility, what alterna- 
tives could be considered for improving the effectiveness of 
the system? 

7. Conceptually, how could the various alternatives be evaluated 

so as to provide some basis for deciding which ones to 
actually implement? 

8. Do you have any other suggestions for things to be done 
before the selected alternatives are finally implemented? 
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IMPORTANCE. For functions A1 to D5, except those marked NO, please answer the following question using the scale 
-VG-Very Great, -G-Great, -S-Some, -L-Little, -VL-Very Little. 

If D/MM were performing the roles and activities as you indicated, to what extent would D/MM’s performance 
in that function be important to your organisation? 
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On what basis do you think the ALC Directorate of Materiel Management should be evaluated? 
List as many criteria as you believe appropriate. 
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THANK YOU FOR YOUR ASSISTANCE 



APPENDIX III 
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VIEWS OF CURRENT AND PREFERRED D/HM ROLES 
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APPENDIX V 
SURVEY COMMENTS 

ALC-D/MM EVALUATION CRITERIA 

The following comments are open-ended responses to the Survey 
Questionnaire - Part IV - Evaluation: "On what basis do you think 
the ALC Directorate of Materiel Management should be evaluated? 
List as many criteria as you believe appropriate." 



LG EVALUATION SUGGESTIONS: 

1. Ability to provide parts when needed. 

2. Spares support. Spares forecasting. Depot cannibalizations 
(response). Support of MICAP requirements. 

3. Accuracy of supply/eqp req forecasts; responsiveness to HQ 
directed changes; supply/eqp fill action timeliness; procurement 
completion timeliness; budget execution; ALC repair flow times; qc 
of ALC repair/ overhaul ; status tracking of requirements; issue 
from WRSK vs PDS ; base level stockage effectiveness; response tc 
over-priced, FWA allegations; recovery actions in over-price/FWA 
cases; resolve disputes between WRSK and WPARR on a "user 
friendly" basis; improve ADP, data systems available to inventory 
manager/system manager. 

4. FMC rates (broken down to NMC rates). WRSK fills. 

5. Ability to deliver spare parts in a timely manner. Ability tc 
procure spare equipment in a timely manner. 

6. Costing of repair work on aircraft. 

7. Responsiveness and timeliness. Field level (base level) 
stockage effectiveness. 

8. On time delivery based on MAJCOM forecast (D039) , this is 
bottomline. Timely turn of reparables (10-20% delinquent) ; 90% 
stockage effectiveness (spares) . 

9. As far as equipment is concerned - what is authorized vs what 
is on hand or length of time to acquisition support equipment. 

10. Customer support - accomplished via annual surveys to 
MAJCOMS; response time to major problems (such as safety TCTO, 
modification proposals, etc.); Timeliness of contracting efforts; 
new equipment purchases; depot remanufacture efforts. 

11. Effectiveness of support for weapon systems i.e., NMCS , NMCM 
rates. Effectiveness of depot maintenance support for each weapon 
i.e., RDM schedule effectiveness. Response to T . 0 . 00-25-107 
request. Management of modification program. 
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12. Quality of products users require to perforin mission; 
timeliness of response to demands on system. 

13. Timeliness of POM coordination and submissions. Processing 

time for mod proposals. Responsiveness to demands for depot-level 
assistance: field user identified problem; spares levels; Cat I 

MDRs NMCS rate. Flow time of aircraft in PDM. Technical 
assistance accuracy. Timeliness in issuance of TCTOS and other 
essential technical instructions. Field repair and recovery of 
aircraft. Number of PIRG items successfully completed each year. 
Number of mods started each year (actual hardware on the 
aircraft) . 

14. Ability to provide material, technical and managerial support 
to aircraft/equipment users. 

15. 

Providing of support to customers i.e., using commands. 

16. 

Compilation, coordination and satisfying user requirements. 

17. Timeliness and quality of product support to customers. 
Average delivery days of priority/routine requisition plus age of 
backorders. Cause code H MICAP rate. 

18. Service to customers: - quality of depot repaired items; time 
required to fill requisitions; timeliness of spares and test 
equipment support to new systems acquisition. 



MA EVALUATION SUGGESTIONS: 

19. Budget execution. Percent of competitive bids. FMC 

rates on assigned A/C. C rating elements of systems supported. 
Fill rates/back orders. 

20. Accuracy of req (consumption and maint) projection; 
timeliness of mod processing; tech data maint, etc; quality and 
timeliness of engineering support; quality of end item support 
thru component buys, stockage, distribution; timeliness of 
responsiveness to user requirements - both consumption and 
mission/need changes; fiscal responsibility & program execution; 
product improvement efforts; quality of provisioning efforts; ILS 
planning adequacy. 

21. Support to the fleet. Support to the depot repair effort. 
Timely procurement of parts. 



22. The accuracy of their workload projections vs actual 
supportable requirement. Management of funds (requirements vs 
dollars not used.) 
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23. Support activities to maintain aircraft production. Amount oj 
work-around for parts. How long it takes an engineer to give us a 
decision on a fix or update on T.O. 

24. Timeliness and accuracy of workload requirements 
projection/data. Adequacy and accuracy of the data provided for 
workloads negotiated with us. Spare parts and asset posture for 
workloads negotiated with us. 

25. Requirements determination, validity. Support of assigned 
weapon systems. Management of modification/configuration program. 

26. 

MICAPS. Fill rate. Dollar obligation goals. Validity of 
requirements computation. Repeat buy notices. PR processing. 

27. Support to the customer. 

28. Support to operational commands. 

29. Service to operational commands; aircraft 

readiness-peacetime/wartime. All evaluation criteria should be 
subdivisions of service; -parts support; -technical; -aircraft 
in depot status; -modification requirements. 

30. Weapon system support. For MISTR items, beginning 
negotiations vs ending negotiations. 

31. Complete supportability of negotiated requirements. Adequaq 
of engineering and technical data support. System program 
management involvement in repair processes. 

32. How well does he meet the customer's requirements. 
Operational readiness rates; operational availability; fill rates 
for POS/WRSK/BLSS ; MICAP/critical item rates; timeliness in 
meeting lOCs/FOCs/acquisition plans/integrated log plans/PMRTs. 

33. Workload negotiations. Parts support. Management of systems. 
AWP-G-code support (this could be temporary if intensified 
management action was applied) . 

34. Weapon system support/combat readiness of weapon system. Iter 
availability. Exchangeables reliability. 

35. Weapon system support/ operational readiness/safety. Item 
availability. Reliability and maintainability improvements. 
Technical Data availability/usefulness. Problem resolution 
support. Software configuration management. 
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DS EVALUATION SUGGESTIONS: 



36. Customer support effectiveness. Active items managed. 

37. Support effectiveness. 

38. Frequency that customers receive material when it is 
required. Volume and age of backorders. System NMCS rate. 

39. Timely: mod processing & installation; purchase request 

preparation and planning; technical order changes; filling of 
requisitions; technical field assistance support. 

40. Fill rate. Backorder rate. Backorder time. Number of 
suspended assets. 

41. Support on fills to depot maintenance. 

42. Item management. Asset availability. Acquisition 
timeliness. Adequacy of provisioning. 

43. Daily working relationship with the D/MM is adequate to 
support our needs and requirements. 

44. Accuracy of requirements projection within 90-98% range. 
Initiation and mgmt of funds to acquire spares, modifications, and 
repair of items. Inventory mgmt; assets on hand vs. requirements, 
disposal, utilization, location (depot vs base), customer support. 

45. Management of items. Timeliness and accuracy in response to 
inquiries . 

46. Management of critical items; management of resources 
(manpower/equip) ; mission support (right item, right quantity, 
right destination, right time frame) ; management of suspended 
assets . 

47. Fill rate on requisitions. Least number of manager review 
items. Highest number of preposition/redistribution orders P/RDOs. 
Least number of post-post transactions. 

48. a. Timeliness, b. Accuracy, c. Consistency and thorough 
coordination of all directorates. 

49. Mission capability of weapons systems they are assigned to 
manage . 
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PM EVALUATION SUGGESTIONS: 



50. Support to customer units. Cost performance. 

51. Initiation of purchase requests. Lead time (administrative 
and production) away from need date. 

52. Track time acrft, in depot status are at work stop for parts 
or tech assist (takes 2-3 days to get engine from bldg 3 00 to 12! ' 
during the MMRB process eval not only man hr reductions, but 
workday reductions. Amrep extensions should be deleted altogethei 
However, if an acrft is placed in an amrep extension, the time »' 
should be accounted to MM for accepting the workload and not 
averting the delay. 

53. Fill rates; item management (acquisition, distribution, rigl: ' 
item- right quantity); acquisition lead time; quality of 
specifications, statement of work, purchase requests etc; number- 
of urgent purchase requests; competitive vs sole source 
acquisitions . 

54. Priority #1- good up front requirements planning - "getting 
most bang for the buck" this includes reduction in turmoil 
(reduced PR amendments, cancellations, PR surges, etc) . D/MM 
should analyze budget, determine requirements and initiate PRs ir 
timely/quality fashion. 

55. All of the functions identified as areas a,b,c & d above in 
regard to processing of individual documentation which evidences 
completion of tasks in established standard time periods. 

56. Timely PR initiation. Minimum PR amendments. 

57. Ability to initiate budget programs early and wisely. Provic 
efficient quantities to buy. Use of multi-year requirements. 
Reduce number of amendments to PRs and cancellations. Reduce 
number of ADRs . 

58. Weapons system support; accuracy in forecasting requirements 
number of purchase requests initiated; number of purchase request 
amended, cancelled or returned; number of termination notices 
issued, number of ASI/ADRs issued. 

59. Fill rates; or rates of systems supported; percentage of 
urg/emerg orders initiated; program execution; timely initiation 
of PR; quality of PRs init. (PR return rate as measure); number c 
priority orders; time required to process modification packages 
through CCB process. 

60. MICAP rates, fill rates, effectiveness of configuration 
management, quality of tech data packages, provide with purchase 
requests, timeliness of requirements and initiation of PRs. 

61. Weapon system support. 
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62. Timely initiation of requirements. Results i.e., meeting the 
FMS customer's needs. 

63. Plan ahead and consolidate requirements. Expedite PRs to 
prevent aging. 

64. Planning, budgeting-inventory management; weapons systems 
support; quality of all functions. 

65. Customer support. Quality of purchase requests including work 
specifications and data. Timeliness of purchase requests. 
Responsiveness to identified problems. Program execution. 

66. Based on timely and accurate response to technical questions 
that impact acquisitions; based on capability to provide good 
procurable packages for procurement action; based on need to buy 
an item no more frequently than annually. 

67. Are purchase request imitated and processed timely 
w/realistic delivery schedule? Are req data pkgs adequate and 
provided on a timely basis? Are first article req realistic 
w/realistic sch? Does gov't have necessary equipment and is it 
available to support reqs? Are protected data purchases realistic 
and necessary? Are requirements packages clear and complete when 
initiated? 



SI EVALUATION SUGGESTIONS: 



68. MICAP; delivery time. 

69. Weapon system reliability, sustainability, availability. 

70. As I reviewed the questionnaire I questioned the value of 
information systems input (SI) . We (SI) are a service 
organization. Our major role is to provide ADP support to the dir 
e.g., D/MM. Realize D/MM is the hub, but I feel the survey deals 
more with DS, MA, etc. 

71. Acquisition of spare and end item parts. 

72. Customer support; pipeline time; fill rate; number of 
backorders and age; number of denials; number of followups from 
customer. 

73. Support given to other Air Force organizations; how well they 
execute their budget. 
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XR EVALUATION SUGGESTIONS: 



74. Program execution; MICAP trends; some method should be 
created to measure how well MM prevents tomorrow's problems. 

75. Mission capability in field. Reliability of requirements 
forecasting. 

76. Weapon system support; modification planning and execution; 
technical support user; execution of spares procurement; funds 
management . 



CR EVALUATION SUGGESTIONS: 



77. Ability to provide effective, timely support to customers in 
areas of spares, repairs, modifications and sustaining 
engineering . 

78. Effectiveness in supporting mission requirements. Attitude 
in complying with public law. Effectiveness in competing 
purchases . 
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APPENDIX V (CONTINUED) 



IMPROVEMENTS IN EFFICIENCY OR EFFECTIVENESS OF D/MM 



The following are open-ended comments from the Survey 
Questionnaire, Part V -Improvements- "Please list specific things 
that could be done to improve the efficiency or effectiveness of 
ALC D/MM." 



LG COMMENTS: 

1. Increase amount of spares at field level. Many items cannot 
even support MICAP rqmts due to very few spares/reps available. 
Depot tends to hold on to some assets rather than support field 
rqmt. Attempt to weed out contractors who cannot perform. 

Improve support from IMs concerning MAC MICAP rqmts. Insure items 
are not "high demand" before cutting funds for repair. 

2. Educate IMs on the items they support, SMs on the systems 
they support; get IMs/SMs out into the field; get customers into 
the ALCs; develop a coherent non-aircraft WRSK system; make 
forecast comp data systems credible or scrap them; insure that 
AFLC, ALC and customers know when, how to input requirements; 
develop feedback system to customers on requirements, asset buys 
vs funds alloted. Fix CSMS. Fix WCDO. Fix WPARR. Fix WRSK. 

3. More power/control to the SPM. 

4. Estimating maintenance work more accurately. 

5. Eliminate manual intervention by inventory managers in the 
dist process, where capable. Enforce and/or educate inventory mgrs 
on parity of supply priorities within priority grp. Revise 
apparent mistrust and/or disregard of equip forecasting system. 
Improve repair system to be proactive rather than reactive. 

6. Amount of time to contract out an item. Cut down on red 
tape to procure or repair an item; ease contractual process. 

7. Reduce the time it takes to procure support equipment. 

AFEMS modernization is a must. Why do we forecast equipment 5-7 
years in advance when acquisition seems to start about 3 years 
before need date? 

8. Better repair capability of recoverable items. Educate 
people on mission avg units/AF units, why spares support is 
important . 

9. Eliminate the cumbersome D039 system, replace with a 
simplified user friendly, accurate comp. Get state of the art 
computers for monitoring equipment purchases, allocating, etc (get 
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out of stubby pencil mode) reorganize — this is essential if ALCs 
are ever going to be customer oriented. They must have 
functionally oriented focal points - not like MMV that cuts acros. 
functional lines. 

10. Continue with a check and balance system but cut the time 
to get on contract for services to support mission essential 
requirements. Too many people in coordination cycles. 

11. The D/MM and his system program managers must have greater 
control of the supporting ALCs (IMs and TRCs) operation. He needs 
more clout. The TRCs are in a different world and appear to care 
less about the needs of the user. They are not in tune with the , 
degree of urgency that exists in the MAJCOMs. Eliminate the 
bureaucratic need for meetings — meetings — meetings, the MMs and 
PMs have little or no time for predicting and planning. Add 
dedicated staff of engineers to each PM. 

12. Indoctrinate ALC personnel to mission of supported 
commands. Establish common frame of reference as to mission 
importance. More efficient use of technical and service personnel 
thru streamlining/enhancement of data systems. 

13. Streamline mgt so that problems can surface to necessary 
level for solution; create can-do attitude instead of continual 
resistance to change; rotate more CAPT level blue suiters thru 
D/MM functional offices; reduce time required to process PRs 
through CR; change process for acquisition of common test eqpt 
(cannot be accomplished in time through SERD process) . 

14. Increase productivity thru better supv at organic 
facilities . 



MA COMMENTS: 

15. Reintegrate end item/weapon system support. Fractionalized 
responsibility between SM, IM, DLA etc. , Dilutes mission "focus" 
and thus responsiveness to on-going problems. 



16. Let each D/MM control the weapon system support parts, tec) 
data, etc required to maintain and repair assigned systems. GSA 
and DLA should not be handling, buying, or responsible for 
aircraft hardware. 

17. One central control point to deal with instead of each 
division being a separate group by itself with a goal of getting 
their requirements completed at the expense of other divisions. 
Money should be managed by MMM instead of each division. 

18. Update on technical orders need improvement. Update on 
blueprints and drawings in a quicker response. 
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19. Attach some responsibility to the authority vested in D/M!-! 
to manage assigned weapon system. Get rid of people who can't or 
won't accurately compute requirements and posture to consistently 
meet both peace and wartime operational needs. 

20. Better management. 

21. Improvement in requirements computation; improvement in 
parts support area. 

22. Make the system manager totally responsible for his system 
and then organize so all functions fall under the system manager. 

23. Enhance role of system manager; resources compatible with 
responsibilities; total authority to control all aspects of 
weapons system support. 

24. More engineering support. Closer coordination with repair 
activity. 

25. Increase number of engineers. Improve geographic location 
between the TRC and supporting materiel management. 

26. Requirements computations methodology must be improved in 
accuracy, speed and timeliness; the key to a healthy support 
posture is tied to it. Procurement lead times, competition 
advocacy, eqp obsolescence, vanishing vendors, budgeting, manpower 
planning, facilities updates, and technology advancement all are 
tied to a credible requirements computation. Improvement in this 
area would significantly enhance the cmd ' s ability to support the 
operation commands' fighting forces. 

27. Provide adequate tech data for organic or potential organic 
systems. Improve provisioning of equipment support and spares. 

More intensified management of end items as they become older and 
are more difficult to support. Be more responsive to production 
repair divisions efforts prior to organic capability. 

28. Provide training relative to use of proper addresses on 
messages sent from MM organizations. Numerous messages are 
received from OC/OO/SM MM organization addressed to Robins AFB LGM 
or LGS which require some type of action. Requires time consuming 
research to determine who should receive message. Numerous 
messages from OC addressed to organizations eliminated eight years 
ago . 
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DS COMMENTS: 



29. More coordination with other ALC components. Increase ALC 
awareness of MM's role and responsibilities. 

30. Improve coordination on all related functions. Assistance 
in resolving common areas of concern. Fostering intense working 
relationships . 

31. Better automation. Streamlined work processes. New blood 
in management. 

32. Use only one comp cycle (a year) on a buy point, and move 
that buy point far enough to the left of 30 Sep to allow for all 
CR and PM actions, that would assure obligation prior to 30 Sep. 

33. Training in suspended assets processing. 

34. Closer coordination w/ depot supply in regards to maint 
support . 

35. Formal and in-house training on systems and interfacing 
systems. Update computer technology. 

36. Faster response to system inquiries would be advantageous, 
if personnel resources were available. 

37. Item mgmt training for all personnel working in this area; 
quarterly, semi-annual. Reduce redundant functions i.e., 
organizational overlapping. Modernize D/MM ADPE. Mid-level and 
upper level mgt crosstrain them in other directorates. Engineer 
training; quarterly, semi-annual; keep abreast of the changes in 
technology. 

38. Training of D/MM personnel to provide an overview of the 
work their counterparts do in other directorates. 

39. Communicate problems/causes freely between MA/MM/DS 
impacting on fraud, waste and abuse. 

40. Provide more up-to-date and on demand disposal information. 
Better trained MM personnel on the way the Directorate of 
Distribution conducts business. 

41. a. Improve communication; b. Improve quality of procurement 
documentation; c. maintain and provide improved item 
identification/description data. 

42. Separate wholesale management of assets from retail assets. 
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PM COMMENTS: 



43. Reduce repetitive buys, buy same item once a year not 
multiple times. 

44. Problems at this depot: 

MMS and MMF issues TCTOs to the acrft div with inadequate kit 
verification. When it is discovered supply does not have enough 
parts for the RTO. MM blames MAB when it was MM's responsibility 
to ensure the parts were available. Item managers frequently 
allow levels to run too low and there is not enough lead time to 
avoid impact on aircraft production. IMs are usually ignorant of 
the technical applications of the items they manage & therefore 
the impact of their decisions. The military officers in the SPM 
offices are sometimes logistics plans officers (AFSC 6624) and 
have no firsthand experience in maintenance, supply, or 
transportation. More often they are pilots with no log 
experience . 

Solutions : 

MMS and MMF should not issue TCTO for C-130, C-141 or F-15 until 
they are sure it is not only technically supportable, but that it 
is supported with the required material (especially hardware, 
special fasteners, rivets, etc) . Item mangers should handle fewer 
items, giving them more time to evaluate problems; probably need 
to update the automation system that provides the data. (I was 
personally involved in a situation where the IM said the system 
was out of C-141 bell cranks, but our phone calls to a few bases 
found 6 in base supplies) . Item managers should have some sort of 
knowledge about the items they control; it would be ideal if the 
IM had worked in D/MA before moving to D/MM; this would cut down 
on the adversary relation between MA and MM (the us and them 
syndrome) . The Air Force should change the entry reqs for the 
6624 (Log Plans) career field. Only people who are fully 
qualified maintenance, supply, transp officers should be allowed 
to cross-train into this field. (Right now there is a major who 
has been a weapon system controller working as a log planner in 
the SPM office.) Traditionally the SPM jobs are given only to 
rated officers (pilots, navigators) with little regard for their 
log experience; should only use rated officers with extensive 
maintenance experience for SPMs. (The attitude I most often 
perceive is operations being sent in to "fix" maintenance.) 

45. More flexibility in buy guidelines; more flexibility in 
funds management; better advance acquisition planning. 

46. Better quality control in purchase request (PR) 
preparation. D/MM needs operational check and balance system to 
assure PR package contains all required information/attachments. 

PR amendments, returns due to PR errors causes loss of time, money 
in executing AFLC budget programs. 
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47. Establish management reporting for factors cited in IV 
above . 

48. More training in purchase request preparation 

49. Provide a manpower system that does not reward the D/MM fo 
initiating PRs. Present system is based on PRs generated and 
rewards inefficiency. 

50. Improved communication with directorate, contracting and 
manufacturing; increased D/MM management awareness of critical 
need for better PR quality; stability of D041 and D062 to 
eliminate quantitative changes from one comp cycle to the next. 

51. Mgt of the outgoing PR/MIPR function now located in PM/DM 
could be handled more effectively if this function were moved to 
D/MM. D/MM should establish a highly effective internal quality 
function for the purpose of improving the quality of PRs and 
accompanying tech data packages. D/MM should make a concerted 
effort to improve the timeliness of req computation so PR could b' 
initiated with sufficient lead time for PM to better perform 
buying functions. 

52. Be more responsive to contract requirements. 

53. Place more responsibility for accomplishing the job in the 
ALC at the same time providing less detailed guidance to them in 
other words, give them more latitude in how they accomplish their 
j ob . 

54. Plan and program to eliminate small dollar procurements, 
under 25,000. Take positive action to reduce the number of PRs. 

55. Develop a system of quality control over all functions sucl 
as specifications, purchase request preparation, etc. These 
functions are now well below an acceptable level. 

56. Streamline process such as configuration management, 
manufacturing data storage/availability; improve technical input. 

57. Assure that realistic delivery schedules are established 
for first article requirements. Require high level approval before 
submitting first article req. Assure that req for continuing 
programs are generated in a timely manner. Assure that data 
packages are complete and adequate before submission of PR. 
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SI COMMENTS: 



58. Assign computer (s) to SI. 

59. Fewer, better skilled personnel with automated information 
systems. Electronic communications between all levels of 
personnel . 

60. D/MM and all directorates in general, should become more 
involved in the concepts of defense resource management which you 
have presented at the Naval Postgraduate School, i.e., in the area 
of ADPE we need to start building business cases and measure the 
ROI of decentralized (D/MM) vs centralized(SI) when purchasing ADP 
for weapon/general purpose support. 

61. On- going and upgraded training; reorganize to private 
corporation structures (i.e., profit making, etc); artificial 
intelligence; cross training from the IM to equip specialist to 
DS , etc; new and innovated ideas and techniques such as Chrysler 
Corp uses; improve employee morale by instituting proper 
incentives . 



XR COMMENTS: 

62. Stop reorganizing so often. Problems are being moved 
instead of solved. 

63. Our D/MM needs more stability. 

64. ADP upgrade; reorganization along weapon systems lines 
(effectiveness) ; reduction of MMI organizational layering. 



CR COMMENTS: 

65. Stabilize item manager assignments. No one stays with the 
same items for any length of time. As a result nobody ever becomes 
familiar with their items and they continue to make the same 
mistakes. Require PR quantities to cover 2 years requirements. 

This will significantly reduce PM and MM workload. Increased 
warehouse and interest costs would be offset by lower prices due 
to more economical order quantities. 

66. Stress advanced planning to allow adequate time for routine 
buys and maximum competition. 

67. Become conversant with requirements dictated by recent 
public laws. Learn the true mission of competition advocate and 
strive to integrate achievements between MM, CR, PM. 
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68. EDGARS will accomplish. 

69. Develop specific long range plans dealing with the need ani 
support of specific weapon systems. 



QA COMMENTS: 

70. Consolidation of various management functions, such as 
technicians and item managers working for same supervisor. 

71. Set goals on reliability and maintainability for each 
weapon system/sub system. Get the user involved in providing idea: 
on how equipment can be improved. Make everyone involved in MM, 

PM, QA and MA aware of the reliability requirements of specific 
equipment and how well it is performing. i 



HQMM COMMENTS: 



72. Enhance acq pgm mgt capability (policy, procedures, 
organization, skills) . 

73. Provide more manning to support acq pgm; more manning to 
software support; automate manpower intensive processes. 

74. Greater technical cooperation with D/MA. 

75. Establish career rotation pgm for all GM13-15 with one yeai 
terms at HQUSAF and HQAFLC and 2 ALCs before next promotion. 

76. Give civilian managers more feel for real-world support 
situations by trips to the field. Automate more item management 
functions . 



SW and SF COMMENTS: 

77. Increase middle management effectiveness. 

78. For our objective answer, an in depth analysis of the D/MM' 
would be required. 

79. Reduce size. Computerize/mechanize. 

80. The D169 system supply support requests need to be 
programmed to accept supply support requests generated by AF. This 
will improve supply support for other af users needs besides D/MM. 
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81. The D/MM needs to be cleansed of its concept of 
preeminence. It is one directorate among several which must 
exercise a balanced interface for the ALC to be successful. Too 
often the D/MM will strive for its own success at the cost of 
another directorate's performance, forgetting the ALC mission. 
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APPENDIX V (CONTINUED) 
ADDITIONAL COMMENTS 



This section lists the open-ended comments made by 
respondents in the survey questionnaire, PART VI - COMMENTS - 
"Please use this space for comments you wish to make or to addres: 
other questions you believe should have been included in this 
survey." 



LG COMMENTS: 

1. We need parts! 

2. Biggest ALC problems are: antique, inaccurate, ! 

unintelligible, unresponsive data systems which are either used or 
disregarded on a nearly random basis. Failure of management 
systems to reflect anything close to reality (e.g., non-aircraft 
WRSK; use of WRSK equipment procedures on non-EAID or mixed WRM 
assets such as HARVEST EAGLE -BANE -FALCON) . Lack of knowledge 
IMS of the items they manage or their customers. Lack of customei 
visibility on requirements determination, tracking, progress 
toward satisfaction. 

3. Increase substantially inventory mgr orientation trips to 
bases. Most inventory mgrs have little or no concept of supply 
maintenance operations and pressures for sortie generation at base 
level. Similarly, supply/maint personnel at base level are unaware 
of ALC processes. Peculiar to the reserve component is the 
apparent bias to support active before reserve. Education on 
reserve/active duty mission essential. 

4 . A bit over most logistics peoples head unless they have 
worked at ALC. 

5. Survey difficult to apply to just this job. Many of the 
questions reach across several boundaries of LGX, LGS, and LGM 
responsibilities. Would like to see it more streamlined to each 
functional area. 

6. The survey (SECTIONS II and III) is much too complex, with 
instructions which make it very time consuming. 

7. The flow time for PDM and major repair is extremely long. 
Commercial carriers would go bankrupt if they lost an aircraft to 
heavy maintenance for period of 90 to 180 days. A solution to 
reduce this ridiculously high flow time is to motivate the people 
involved to the user's mission and the importance of airframe 
availability. We have built-in roadblocks under the current 
concept. An alternative is to place PDM work requirements under 
the control of the using commands. No way would the TRCS or 
repair of equipment be transferred — only the inspection and 
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repair of aircraft. The MAJCOMS could develop a higher esprit de 
corps and mission oriented operation whether they use a civilian 
or military work force. The SPMs must limit scope of his activity 
to a prioritized list of problems/projects. Use PIWG as his 
baseline for those time phased requirements of the weapon system 
master plan. Align IMs functionally to a single ALC, i.e., all 
hydraulic systems/components assigned OC-ALC — all environmental 
systems WR-ALC, etc. 

8. I have marked a fairly low performance level in SECT II, 
but, want to clarify that most of it stems from the structure that 
literally ties the hands of mgmt in getting the job done. A lot 
of super people trying very hard to give support. When support is 
good we see very little, when support is bad flags go up 
everywhere. 



MA COMMENTS: 



9. D/MM manpower standards are a joke. Do not fence 
engineering resources. Let eng compete with IMs, PMs, and ES . 

10. From the maintenance work load/posture plan a means of 
prioritizing work load within the command should be developed. The 
maintenance directorate at all ALCs must deal with five D/MMs who 
think they are the only ones in the world. 

11. Questions should be tailored more toward all organizations, 
i.e., too general, should be related to using commands, other 
commands, other organizations within an ALC, etc. 

12. Poorly designed survey, could have been designed to be much 
easier to do a good job. 

13. Believe there is a need for much more coordination/team 
play. The technical expertise and wisdom of the ALC maintenance 
community is not used to the fullest extent in the acq process. 

The AF experts in support eqp, testability, test software, etc, 
are for the most part, not brought to bear during the SE 
definition phase. The Air Force has the expertise, it is not used 
anywhere close to the degree it could and should be. 

14. Part IV is a bit much too ask in this kind of survey. 
Obviously mission support and customer support are the broad "buzz 
words" but criteria for evaluation gets very complex. My main 
problem as a senior maintenance manager dealing with IM/SPM 
functions re the D/MM here is attitudinal. There is not a sense 
of team effort. There is an attitude that all other activities 
are subordinate to the SPM/IM and while it is true that the SPM/IM 
is the"quarterback" , they seem to forget there is a team here. 



61 



DS COMMENTS: 



No comments . 



PM COMMENTS: 

15. Survey does not adequately address D/MM - D/PM 
relationship. 

16. The function of my current position really disqualifies me 
from this survey. Plant mgmt within a directorate of maint merely 
installs and maintains equip and facilities for the product div. 
As such we are not considered for the acft mgmt function. The 
product divs (MAB, MAI, MAN) are the ones working with and 
responding to D/MM. 

17. To improve the timeliness of requirements computations so 
that purchase request could be initiated soon enough to allow 
sufficient lead time for PM to better perform the buying function 
to satisfy their requirement. 

18. Improve technical and eng support. 

19. The functions in II and III are generally not applicable tc 
the support we provide to D/MM. 

20 . 

Working relationships with other directorates should be 
evaluated . 



SI COMMENTS: 



21. D/MM has too much overhead. 

22. Parts II and III, D/MM provides input data for IPC to 
process . 

23. This directorate (SI) is not functionally svc by any D/MM 
component, rather this organization provides D/MM information 
systems support to assist D/MM to support other ALC organizations 
such as MA, PM, DS, as well as all AF Major Cmds, including other 
services . 



XR COMMENTS: 

24. The survey doesn't adequately evaluate MM's role in 
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acquisition support for systems which haven't transferred from 
AFSC for management. 

25. For all the critique, this D/MM is far ahead of all others. 



CR COMMENTS; 

26. The categories; al-d5 are not clear as to whether they 
apply to the individual organization's operation or to the ALC or 
directorate operation, i.e., budget planning - for my 
organization or for ALC? Believe all participants answers will 
not be on the same basis. 

27. Emphasis should be on new or innovative techniques that 
will accurately forecast requirements, shorten administrative lead 
time on acquisitions, and permit full and open competition. 

28. Difficult for an organization interface to be described in 
terms of role defin. For example, I was forced to use TS to define 
some of the interface, yet D/MM does not task us direct. We react 
to actions they take which evolves workload for us, i.e., the buy 
program for parts and services generated by D/MM drives our data 
screen operation and competitive actions. 



QA COMMENTS; 

29. Staff quality function is necessary to carry on unbiased 
functions to eliminate problems and provide correction of quality 
workmanship defects instead of covering them up. 

30. Section III is moot since AFLC has directed quality 
function will be performed by MM and PM. 



HQ-MM COMMENTS; 

31. Survey not achieve it purpose. Only SEC IV relates to 
evaluating MM. 



SW and SF COMMENTS; 

32. Confusing format. 
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PRIMARY MM FUNCTIONS 
% BY RANK/GRADE 
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